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: ABSTBACT 

Between July 1978 and June 1980 a program evaluation 
vas undertaken in Pennsylvania in order to measure compliance vith 
state day car€ licensing regulations* The evaluation involved 
approximately 1000 licensed/approved child care centers and 50,000 
children* Statistical data indicate that by the period April to June 
19B0 the statewide compliance percentage was well above 96&« 
Compliance in individual centers ranged from 63% to 100S* Although no 
significant statewide differences between private and public centers 
were found, there were slight regional differences* Approximately 
twc^thirds of the centers completed evaluations in both fiscal years* 
Variation across regions again was found in the pretest to posttest 
comparisons, : but all regional totals increased* Ihe statewide 
increase in ccmpliance was statistically significant* In the second 
fiscal year <1979 to 1980) a scoring protocol was implemented* Each 
questionnaire item had a weight assigned to it in order to measure 
relative risk to children* By the fourth quarter of the second fiscal 
year there were only eight (out of 275) items on which fewer than 90X 
of the programs were in compliance* The eight items were 
predominately in the child health component and involved screenings 
and immunizations in particular* Levels of non-compliance are 
reported for the following immunizations: DPT, Polio , Measles, 
.Bubella, and Rumps* Correlations between unit cost and compliance 
iiievel as well as between program size and compliance level also are 
reported* (Author/BH) 
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ABSTRACT 

This is a study embedded in the child care ecology which focuses 
on child day care centers in the Commonwealth of Pennsylvania 
over a two year period. The study involved over 1000 centers 
and approximately 50,000 children. The study assessed program 
compliance with state regulations in the following areas: ad- 
ministration, environmental safety, child development program, 
nutrition, social services, transportation and health services. 
Also results are reported on cost and size of the day care pro- 
gram relating these data to compliance data. This study repre- 
sents a new avenue in the assessment of the child care ecology. 

It is a first attempt in the child care field at the state level 
in the use of a scoring sprotocol which measures relative risk 
to children in care. The evaluative approach used in this 
study is applicable to other child care settings and delivery 
systems, such as child welfare. 



This is a report of a program evaluation undertaken .in Pennsyl- 
vania (Child Development Program Evaluation — CDPE) involving approxi- 
mately 1000 licensed/approved child care centers and 50,000 children. 
These centers were publicly as well as privately funded. The report 
period is from July 1978 to June 1980. 



1 All results reported are from the Ecological Monitoring Information 
System (EM IS) and the Child Development Program Evaluation (CDPE) 
Instrument. 
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The program evaluation measured compliance with state day care/ 
licensing regulations in Pennsylvania. The regulations were grouped 
into seven categories: administration, nutrition, social services, 
transportation, health, child development and environmental safety. 

Before giving a detailed breakdown of the data, there are state- 
wide data which gwe an overall indication of compliance for all pro- 
grams. When the COPE project began in July I978, the initial state- 
wide compliance percentage for all sites measured in the first quar- 
ter (July-Sept 1978) was less than 85% compliance. By the l.jst quar- 
ter of Fiscal year 78-79 (April -June 1979), COPE evaluations showed 
a statewide compliance percentage for all programs of just below SQ% 
compliance with regulations. By the last quarter of Fiscal year 
1979-1980, (April-June I98O), the statewide compliance percentage 
was well above 96^ compliance with state regulations. (See figure 1 
for the total eight quarters and the respective percentages). 




The range in percentages in individual centers was from a low 
of 63^ to a high of 100% compliance level. Private as well as pub- 
lic centers were eval uated, and there was no significant difference 
between the two categories statewide; however, there were some 
slight regional differences. 

Approximately twc-thirds of the centers had a pre^post test 
administered. This means that a CDPE was completed both in J^^JSt 
and then in 79*80. There again was variation across the regions, 
but all regional total s increased; it was just a matter of magni* 
tude. Statewide the results were significant: in 78-79 the over- 
all compliance percentage was approximately SQ%; by the post-test 
in 79-80, the overall compliance percentage was over SSZ (t«5.3A; 
p<.001 ;df«54) (See figure 2 for the regional and statewide break- 
outs). 




1978-1979 1979-1980 
FISCAl. YEARS 

FIGUr^E 2 . 

in Fiscal year 79-80, more detailed quarterly reports were begun 
where not only overal I percent compl iance was calculated but a 
scoring protocol was inscituted experimentally. 



This means that each item within the CDPt* had a weight assigned 
to it. This weight measured relative risk to children. The 
final scores which are reported here are but a compilation of the 
Individual weights assigned to each item that appears not in com- 
pl lance. . 

When the scoring protocol was Initiated In the first quarter 
of FY 79-80, the total scores for programs in the regions were: 
Northeast Region * 85; Southeast Region » 113; Central Region 
« 119; Western Region * A5. A higher score Indicates a higher 
level of non-compl lance. 

In the fourth quarter of FY 79-80, the scores had a very 
different configuration regionally. Northeast Region *27.06; 
Southeast Region « 62.^3; Central Region « II A. 16 and Western Re- 
gion « 16.63 (See Chart 1 for a more detailed quarterly display). 



REGIONS 


QUARTERS 


1 


2 


3 


4 


NORTHEAST 


85 


67 


72 


27 


SOUTHEAST 


113 


127 


65 


62 


CENTRAL 


119 


124 


103 


114 


WESTERN 


45 


18 


21 


17 


STATEWIDE 


92 


84 


65 


55 



CHART I 

* Another approach for looking at the data is to analyze 
the scores for the seven component areas over the quarters. 



That type of data was initiated In the second quarter of FY 79-80. 
Therefore, there are no figures for the first quarter of FY 79-SO. 
For the second quarter and the third quarter of FY 79-80, the 
following were the scores by component areas: Administration went 
from a score of in the second quarter to a score of 27 in the 
third quarter; Environmental Safety remained virtually unchanged 
at a score of l6; Chi Id Development decreased slightly from a 
score of 2.A1 to 1.72; Nutrition decreased from 1.02 to 0.5^; 
Social Services decreased from 6.79 to 5.89 score; Transportation's 
score decreased from 1.95 to 1.71; and Health decreased from a 
score of 21 to 12. (See Chart 2 for more detailed data). 

The administrative, social services and health components 
showed significant decreases which means the programs evaluated are 
coming more into compliance. All the other component areas either 
remained relatively static or changed positively in only a slight 
way. 



COMPONENT AREAS 


QUARTERS 


2 


3 


4 


ADMINISTRATION 


42.28 


27.39 


23.54 


ENVIRONMENTAL SAFE 


16.26 


16.55 


15.04 


CHILD DEVELOPMENT 


2.41 


1.72 


1.38 


NUTRITION 


1.02 


0.54 


0.06 


SOCIAL SERVICES 


6.79 


5.89 


2.49 


TRANSPORTATION 


1.95 


1.71 


1.87 


HEALTH 


21.21 


11.56 


9.35 



CHART 2 



There were two other reports that were used in FY 79-80 that 
were not used as comprehensively in FY 78-79, although ^He first 
that is described did have its roots in FY 78-79- The first of 
these reports Is a frequency report to determine the number of 
items that are out of compliance at a significant level ( ZS% of 
the programs or greater being out of compliance on an individual 
item). In FY 78-79, there were 81 individual Items within the 
COPE thac met the 25% criterion. By the first quarter of FY 79- 
80, there were only 13 individual items, that met the 2S% criterion. 

it was at this point that the criterion level was lowered 
from 25% to ]0% which meant that oh any individual item if only ]0Z 
of the programs were found out of compliance this would consti- 
tute being reported on the frequency report. As predicted, becauise 
of the more stringent criterion, the number of items went up to 
17 individual items that met the new criterion for the 2nd quarter. 
By the third quarter the number was reduced to 14 Individual items 
and by the fourth quarter it was down to only eight (8) individual 
Items that met the stringent \0% crierlon. This means that all 
other items (there are 275 individual items in the COPE) are being 
complied With by greater than 90^ of the programs, and, there are 
only 8 out of the 275 items where less than 90^ of The programs 
are in compl lance . (See Appendix I ) 

The lowest levels of compliance ( the eight items) are pre- 
dominately in the child health component and involve screenings 
and immunizations In particular. 



It was because of this particular problem that the following 
report was maintasned. It was started in the 1st quarter of 79-80 
because of the high levels of non-compliance with the immunization 
and screening Items. 

This last report is the Immunization Report and it gives the 
levels of non-compliance for the following immunizations: DPT, 
Polio, Measles, Rubella, and Mumps. These data are reported by 
Individual site and are shared with the Pennsylvania Department 
of Health. The Immunization Division then follows up on the pro- 
grams that are severely out of compliance. 

In the First Quarter, 55^ of the programs were substantially 
out of compliance with having the children in their care prop^irly 
immunized. By the Fourth Quarter, Z]% of the programs were sub- 
stantial ly out of compliance. This Is a marked Improvement, but 
It still remains as one of our most difficult sr ^as of compliance. 

There were also some other results that did not become part 
of the usual reporting system but were one time special reports. 
In one of their special reports, COPE data were cross-walked with 
fiscal and reporting data in the Title XX day care centers. Pri- 
vate day care centers are not included in the next set of data. 
Two very interesting relationships were ev'dent which I will very 
briefly describe. 

When the fiscal and COPE data are crosswalked, very *low priced 
prografns were found to have very high scores indicating a high 
level of non-compliance. 
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As the unit costs increased for programs » the scores did 
gradually decrease which would be predicted. However » this 
relationship did not continue throughout the highest priced 
programs ($A,000 +/chi Id/year) . In fact with the highest 
priced programs the scores actully went bacl<L up again indicating 
a higher level of non-compliance. (See figure 3 for a graphic 
display of this phenomena). 



CDPE 
SCORES 
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UNIT COST 
FIGURE 3 

The other relationship occurred when CDPE scores and size of pro 
gram data were crosswalked. 



A similar type of relationship was found as in the crosswalk be- 
tween fjscaland COPE data but in this case the relationship was 
not as strong. The larger (^00+chi Idren) and the smaller (less 
than kO children) programs were found to have higher COPE scores 
than the programs of moderate size (50-300 children). 

This study reports on a project instituted in Pennsylvania 
that attempted to more objectively evaluate program compliance 
with state day care regulations. The scores are measures of 
risk factors that would potentially injure children in child care 
settings. They are a first attempt at measuring the quality of 
the child care environment. 
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CDPE FREQUENCE COUNTS-SUMMAIt? REP0RT"19?9-^1980 





QUARTERS 


ITEMS 


10-12/79 


1-3/80 


*4-6/80 


Written Referenoee (47)^ 


65% 


78% 


74% 


Child Health Appraisal (23?) 








^Height and weight (d) 


87% 


90% 


90% 


^DPT (e) 


89% ' 


89% 


95% 


"Polio (f) 


89% 


87% 


98% 


\ ^Measles (g) 


90% 


86% 


98% 


^Rubella (h) 


87% 


84% 


92% 


'^Mwrps (i) 


81% 


77% 


81% 


^Vision (3) 


71% 


81% 


82% 


Speech (k) 


59% 


76% 


79% 


^Hearing (I) 


74% 


80% 


75% 


Anemia (0) 


58% 


68% 


61% 


^Developmental (p) 


74% 


82% 


74% 


^ Dental (q) 


66% 


81% 


79% 


Application Forms (158) 








"Fktjsioiccn ( d) 


79% 


88% 


97% 


-Emerger.ay Contact (e) 


88% 


90% 


90% 


'Health Insuranoe (f) 


71% 


80% 


98% 


Signature of parent (g) 


86% 


90% 


90% 


Progress (16Ze) 


80% 


90% 


90% 




I 


II 


III 




I /II t 
II/III t 


» 3,69i df - 17; 
a 2.54; n. 3. 


p-K.OOl 



